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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed 02/04/09 have been fully considered but they are not 
persuasive. 

Applicant argues that neither D'hoore nor Riis teach determining phonetic 
transcripts for each of a plurality of words for N various languages not specified as the 
mother tongue to obtain N first phoneme sequences for each word corresponding to N 
first pronunciation variants; determining a phoneme map by mapping the first phoneme 
sequences of each of said N languages to a relevant phoneme set of the mother tongue 
(Amendment, pages 6 - 9). 

The examiner disagrees, since D'hoore et al.., teach that "transcribing the word 
with rule sets from several languages and generate several phonetic transcriptions. 
The recognizer uses all the transcriptions in parallel, thus covering all pronunciation 
variants. This is particularly useful for recognizing proper names in an application that 
will be used by a variety of speakers" (col.8, lines 13 - 20). It is inherent that the first 
phoneme sequences of each of said N languages are mapped to a relevant phoneme 
set of the mother tongue, since all the phonetic transcriptions are used in parallel 
for covering all pronunciation variants for several languages, which also include 
mother tongue language. 
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Claim Rejections - 35 USC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 12, 13, 20, 21, 28, and 29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over D'hoore et al., (US Patent 6,085,1 60) in view of Riis et al., (US PAP 
2003/0050779). 

As per claims 12, and 22, D'hoore et al., teach a method and apparatus for 
automated language recognition of words from different languages comprising: 

(a) loading a phoneme set associated with a language specified as a mother 
tongue into a mother tongue language recognizer ("subword units in a first language"; 
col.2, lines 7- 14); 

(b) determining phonetic transcripts for each of a plurality of words for N various 
languages not specified as the mother tongue to generate N first phoneme sequences 
for each word corresponding to N first pronunciation variants ("generate several 
phonetic transcriptions"; col. 8, lines 13-15); 

(c) determining a phoneme map by mapping the generated first phoneme 
sequences of each of said N languages to a relevant phoneme set of the mother tongue 
("uses all the transcriptions in parallel... for recognizing proper names in an application 
that will be used by a variety of speakers whose language is not known"; col. 8, lines 1 3 
-19). 

However, D'hoore et al., do not specifically teach determining N second 
phoneme sequences corresponding to N second pronunciation variants from said 
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phoneme map for each word; and processing said N second phoneme sequences with 
the phoneme set associated with the language specified as the mother tongue to 
identify at least one of a matching word and a similar word. 

Riis et al., teach capturing both inter- and intra-language pronunciation variations 
which is ideal for multilingual speaker independent speech recognition systems; 
generating pronunciations in response to said sequences of multilingual phoneme 
symbols, and comparing said pronunciations with the acoustic input in order to find a 
match (Abstract, lines 7-10; paragraph 1 5, lines 8-11). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to generate inter- and intra-language pronunciation 
variations as taught by Riis et al., in D'hoore et al., because that would help improve the 
overall system performance of generating multilingual text-to-phoneme mappings (Riis 
et al., Abstract). 

As per claim 13, D'hoore further disclose adding the N second phoneme 
sequences for each word in a language recognition vocabulary located in the mother 
tongue language recognizer ("subword units in a first language"; col. 2, lines 7-14; 
col.1, lines 3 - 7). 

As per claims 20, 21 , 28, and 29, Riis et al., further disclose determining the 
phonetic transcripts of each word for N various languages not specified as the mother 
tongue is performed by at least one neural network; processing said N second phoneme 
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sequences with the phoneme set associated with the language specified as a mother 
tongue is performed using a Hidden Markov Model (paragraph 53, lines 1 - 3). 

4. Claims 14-16, and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over D'hoore et al., (US Patent 6,085,1 60) in view of Riis et al., (US PAP 
2003/0050779), and further in view of Bub et al., (US Patent 6,460,017). 

As per claims 14, and 23, D'hoore et al., in view of Riis et al., do not specifically 
teach determining distances to the N second pronunciation variants based at least on 
the processed N second phoneme sequences 

Bub et al., teach measuring the distance or determining the similarity of two 
phonemes models of the same sound from different languages (col.1 1 , lines 45 - 48). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to measure the distance between phonemes as taught by 
Bub et al., in D'hoore et al., in view of Riis et al., because that would help improve the 
overall system performance of generating multilingual text-to-phoneme mappings (Riis 
et al., Abstract). 

As per claim 15, Riis et al., further disclose classifying each N second phoneme 
sequences ("inter- and intra-language pronunciation variations"; Abstract, lines 7-10). 

However, D'hoore et al., in view of Riis et al., do not specifically teach identifying 
respective distances. 
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Bub et al., teach measuring the distance or determining the similarity of two 
phonemes models of the same sound from different languages (col.1 1 , lines 45 - 48). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to measure the distance between phonemes as taught by 
Bub et al., in D'hoore et al., in view of Riis et al., because that would help improve the 
overall system performance of generating multilingual text-to-phoneme mappings (Riis 
et al., Abstract). 

As per claim 16, Bub et al., further disclose eliminating any N second phoneme 
sequences that do not meet or exceed a predetermined threshold ("distance threshold"; 
col.1 2, lines 51, and 52). 

5. Claims 17, 24, and 25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over D'hoore et al., (US Patent 6,085,160) in view of Riis et al., (US PAP 
2003/0050779), further in view of Bub et al., (US Patent 6,460,017), and further in view 
of Brill et al., (US Patent 7,047,493). 

As per claims 17, 24, D'hoore et al., in view of Riis et al., and further in view of 
Bub et al., do not specifically teach that the distances are Levenshtein distances. 

Brill et al., teach using Levenshtein distance (col. 3, line 31). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to use Levenshtein distance as taught by Brill et al., in 
D'hoore et al., in view of Riis et al., and further in view of Bub et al., because that would 
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help improve the overall system performance of generating multilingual text-to-phoneme 
mappings (Riis et al., Abstract). 

As per claim 25, Bub et al., further disclose eliminating any N second phoneme 
sequences that do not meet or exceed a predetermined threshold ("distance threshold"; 
col. 12, lines 51, and 52). 

6. Claims 18, 19, 26, and 27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over D'hoore et al., (US Patent 6,085,160) in view of Riis et al., (US PAP 
2003/0050779), and further in view of Harengel et al., (US PAP 2004/0039570). 

As per claims 18, 19, 26, and 27, D'hoore et al., in view of Riis et al., do not 
specifically teach determining the probabilities that each word for N various languages 
not specified as the mother tongue belong to a specified set of languages, said step of 
determining probabilities occurring before step (a); and eliminating languages from said 
specified set that do not exceed a predetermined threshold. 

Harengel et al., teach if the probability coefficient for the assignment of a word to 
at least one language exceeds the threshold value, the grapheme-phoneme assignment 
which corresponds to the respective word is supplemented in the pronunciation lexicon 
(paragraph 10, lines 8-13). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to determine a probability coefficient of a word as taught 
by Harengel et al., in D'hoore et al., in view of Riis et al., because that would help 
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improve the overall system performance of generating multilingual text-to-phoneme 
mappings (Riis et al., Abstract). 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to LEONARD SAINT CYR whose telephone number is 
(571) 272-4247. The examiner can normally be reached on Mon- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is (571)- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or (571)-272-1000. 
LS 

05/26/09 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



